DOCOHIM BISOME 



ED IftO 12ft CG Oti 397 

JDIHOB CaiDpbell^ Jfchii P. 

TITLE Structures for Organizational Ef f ectiveiiess Criteria 

and Their Implications. 
EUB DATE Sep 76 

NOTE ' 13p. I Eaper presented at the Innual Conference of the 

American Psychological Asaociation (Skth, Washington^ 
D,C. September 3-7^ 1976) 

IDES PBICE HP-$0-83 HC^S1*67 Plus Postage, 

DESCEIITORS ^Accountability • * Administrative Organization^ 

Efflciencyi Guidesi ^Management by Objectivesi 
Bodelsi ^Organizational Effectiveness; ^Planningi 
^Research Design 



ABSTRACT 

This guide discusses organisational effectiveness^ 
and is divided into the following sections: (1) Preface; (2) 
If fectiveness as a Constructi (3) The Task Objective Hodel; (4) How 
to Assess Effectiveness I (5) Besearch to be Cone; and {6) References, 
CAuthor/JLL) 



||E$ ^ 1^ Jf? ^ ^ 1^ 4e * * * ^ ^ ^ 

* pocuments acguired by EEIC include many informal unpublished * 
materials not available from other sources* ERIC makes every effort ^ 

* to obtain the best copy available. Neverthe'less ^ items of marginal ^ 
t; * reproducibility are often encountered and this affects the guality ^ 
/ * of the fflicicfiche and hardcopy reproductions ERIC makes available * 

via the IRIC Document Reproduction Service (EDRS) * EDRS is not * 

V * responsible for the guality of the original document. Reproductions ^ 

: * supplied by IDRS are the best that can be made from the original. * 



mc 



Structures for Organizational Effectiveness 
CTiteria and Their Implications 



John P. Campbell 



University of ilinnesota 
September^ 1975 



U BlPARTMiNT OF HfiaLTM, 
iPUCATION £ V^ELFARl 
NATrONAL rNSTlTUTi OF 
iOUCATJON 

THIS DOCUMENT MAS BEEN REFHQ- 
DUCED EXACTLY AS RECEIVED F^OM 
THE PERSON OR GROAN 1 2 ATI ON ORlGlN- 
ATlNGjT PO "5 OF VIEW OH QPINiONI 
STATED 00 ...P! NECESSARILY REPRE- 
SENT OF FiClAL NATIONAL INSTITUTE QF 
EDUCATION POSITION OR POLJCV 



Paper presented at a symposium (Current issues in organizational effective- 
ness research) at the American Psychological Association national convention , 
Washington^ Sept,^ 1976. 



-1- 

I would like to do four things in this paper. 

1) Ask you to ignore the title since I cannot reconstruct how it came 
to be. Unfortunately, the episode i£ symptomatic of the topic of organi- 
zational effectivenoss. 

2) Argue that to understand organisational effectiveness, to develop 
measures of effectiveness^ and to decide v/hether a particular measure is good 
or badj one must have a theory or model of effectiveness* 

3) Briefly describe the particular model of effectiveness that I think 
is most useful* 

4) Conmient on v/herc the model seems to lead. 

PREFACE 

Most of these remarks are based on a rather lengthy review of this topic 
that I and three of my colleagues did tvw years ago CCampbellj Botmas, 
Peterson^ Dimnette, 1974), Little has happened since to chwge the con-- 
elusions we reached then, including our own efforts* Organizational effective 
ness is a very complex topic. It has a tendency to turn otherwise articulate 
and proud people into insecure mumblers. TliuSj it is particularly convenient 
that in the interests of time I must sidestep tv/o difficult and trooblesome 
questions : 

1) V/hat is an organization and hov; is it different or superordinate to 
the people in it? 

2) At what level of aggregation should one talk about organizational 
effectiveness: Individuals? Small groups ^ large groups, multi-leveled groups 
functionally distinct departments^ everybody under one roof^ etc,? 
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EFFECTIVENnSS AS A CONSTRUCT 

Organisational effectiveness is a constTUct. It cannot be represented 
by a single variable or set of variables, I think I can assert without fear of 
contradicticn that all atteii^ts to develop a universal sot of such criteria 
have failed, just as they failed with regard to measures of individual perfor- 
mance. In ray opinion, the construct must have at least four ingredients^ 

1) It must deal vdth whether or not organizations have goals, and if so, 
v/hat kind* 

2) It must deal with the puiposes or decisions for which effectiveness 
information is to be used. 

3) It must specify the general procedure by which one moves from a 
general model to a concrete specification of effectiveness indicators. 

4) It must identify what are empirical questions and what are questions 
of values* 

Goals vs. No Goals 

Tv/o major points of view have competed for the prize of the most useful 
general conceptualization of org. effectiveness. Tliey liave been given various 
labels but the most popular are the goal centered viev; and the natural systems 
view (e.g. see Ghorpade, 1971)* 

Tlie goal centered view assumes that the organization is in the hands of a 
r^ational set of decision makers who have a finite set of goals in mind which 
they wish to pursue. V/ithin this orientation, the way to assess effective- 
ness vv^ould be to develop criterion measures to measure how well the goals 
are being achieve, Tliere are a nun^er of variations of the goal centered 
view, TTie management by objectives tradition (e.g, Odiorne, 1965, 1969) 
tends to fail in this category* The recently renewed movement toward 
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cost/benefit analysis (Rivlin^ 1971) is an ambitious attempt to assess the 
actual utility of acconiplishing specific goals. During the 1960's, the attempt 
to derive overall measures of military readiness (Hayward^ 1968; Popper S 
liiller, 1965) is yet anotlier variation* The I/O psyGhology view of individual 
performance is ceTtainly a goal model, 

Tlie natural systems view appears to assume that if an organization is of 
any si^e at all^ it is so dynamic and so complex that it is not possible to 
define a finite nuinber of goals in my v^ay that is meaningful, Ratherj the 
organisation adopts the overall goal of maintaining its viability through time 
i^idthout depleting its environnient or otherwise fouling its nest. Thus to 
assess an organiEation' s effectiveness one should try to find out whether its 
resources are being wisely distributed, whether its adaptive mechanisms are in 
good working order, and so forth. One requirement here is a model that specifies 
the kinds of adaptive mechanism that must be built. It cannot prepare itself for 
literally everything. One clear example of such a model is the one developed by 
Likert and his associates (Likert, 1961^ 1967), In the beginning the basic 
systemic variable was the degree to which subordinates participated in making the 
decisions which affected them. By implication ^ an organisation in which decisions 
were made participatively was a healthy, capable ^ and adaptive organization. 
Tlie list has since been expanded to include communication factors , motivational 
practices j and the like and the current '*state^* of the organiEation is measured 
via a questionnaire • Other exan^les of systems models can be found in the or- 
ganization development (00) domain, such as those outlined by Argyris (1964) and 
Blake and itouton (1968), The OD models tend to define a healthy system in terms 
of open communication J free expression of feelings as well as ideas; open con- 
sideration of conflict, etc, Tlie assumption is that an organization scoring high 
on these variables will be effective. 
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Thus, a natural systoms oriented analyst would not first ask v/hat the organi 
zation was trying to accomplish, but would be concerned with the overall 
viability and strength of th^ system as dofined by some a priori notions of 
what the characteristics of a strong system are. 

Historically, the systoms view was in part a backlash against the goal 
model because of the frustration ej^erienced in articulating a generalize- 
able Set of goals for orgajiizations. An even more radical viev/ is that 
articulated by Georgiou (1973) wlio reminds us of the simple fact that orgajii 
zations are made up of individuals and when we think of organizations as 
..anything more than the sum of a variety of diverse parts , we get in trouble. 
Instead^ it makes more sense to think of organizations as under the control 
of individual preferences* Georgiou is a political scientist , and foreign 
born at that, but his point of view is almost orthodox Sklrinorian. To under 
stand what organizations are trying to do, we must look at specific episodes 
or actions (i.e. responses) and try to discern the incentives that are 
controlling the behavior of the individuals involved, I am in sympathy with 
this point of view and it is compatible with the model of effectiveness that 
I vjish to advocate, wjiich I -11 call the task objectives model* 
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ThG Task Objectives Model 
Thor© is a recurring theme in a number of different domains of psycho- 
logical and educational research that has taken on many of the characteristics 
of a Kiihnian (Kuhn, 1962) paradigm, Ifnile the basic idea has never really been 
applied to the pTOblems of measuring organizational effectiveness^ it appears 
so many other places that I think it deserves consideration in the present 
context. 

Tlie basic message, although trite sounding, is this, If we want to judge-, 
the effectiveness of an ^^intervention'^ dealing with changing behavior, then it 
is necessary to specify the specific behavioral objectives of the intervention. 
Tlie term behavioral objectives is used in a very atomistic sense and one would 
expect a list of such objectives to be quite long for an intervention of any 
complexity. Tlie list constitutes the precise definition of what we want the 
intervention to acconplish in specific observable terms. 

Tliis theme arises in several different contexts, Probably its first major 
articulation came from research and development oh programmed instruction 
techniques where the term '^terminal behaviors*' refers to the specific things 
the learner should be able to do v/tien the PI sequence is completed. 

Hie PI model has been expanded into a comprehensive procedure for designing 
and evaluating almost any instructional effort, 'flie seminal contributions were 
those o£ Gagng (1902), Briggs (1968), and Glaser (1969), GagnS^s now classic 
argument is that if we cannot clearly specify *'what is to be learned^' then it 
is almost axiomatic that we cannot design the training program itself or evaluate 
its ef facts, By analogy, if v/e cannot clearly specify what v/e want an organization 
to do then it is not possibU- to design its structure and functions, or assess 
hov; effective it is. Tlie fact that courses are taught and orgaJiizations are 
designed and assessed anyt^ay is not really an argument for anything. It merely 
means the process of objective spQCification has been intuitive or by default. 
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Althou0h simplistic in form, Cagne^s idea created somothing of a revolution in 
training and curriculum devGlopment because ho^ arguod that applications of 
psychological theories of leaniing are not the primary concern. The straight- 
forward descriptive question of vAat is to be learned is far more important. 
By analogy, theories of formal organization will not help us too much in the 
assessment of organizational effectiveness, llhat will help is the unexciting 
and head-breaking task of deciding what the specific objectives of the organi- 
zation are or should be. 

Obviously anotlier domain in v/hich this theme surfaces is in individual 
performance measurement. Smith and Kendall (1963) used Flanagan's (1954)* critic 
cal incident technique to develop a method for defining individual performance 
in terms of specific behaviors referred to as Behavior Expectation Scaling (BBS) 

Another related area is the push toward so-called ''criterion referenced 
testings for achievement measurement. Criterion referenced testing defines a 
score in terms of the actual skills or knowledges it represents (e.g* being 
able to identify the 17 most common auto maintenance problems) , No mention is 
made of relative standing in a norm group. Test items are selected such that 
the score reflects the level of competency directly. It should be obvious that 
to generate such test items ^ the test developers must understarid the subject 
matter very well in terins of what represents different levels of skill. 

Again, I v/ould like to point out the common theme, Con^etence, or perfor^ 
mancej can only be assessed by reference to a long list of highly specific be- 
havioral ohjectives. Specification of these objectives serves as a rigorous 
definition of what it is we want the individual performer to be able to do. By 
analogy, the way to assess organizational performance is for the relevant 
**e3^erts^' in the organization to specify a reasonably complete catalog of task 
objectives. These objectives should have 3 characteristics* 

1) They must be concrete , observable things that organiaations do, 
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2) Tlie conditions undor which the organisation should be able to do 
^-„.them must be specified, 

3) Tlie degree to v/hich ©ach objective must be satisfied must also be 
nailed do\m- 

V/here then does this paradigm lead with regard to effectiveness assessment? 

HOW TO ASSESS EFFECTIVENESS 

As a first step^ the decisions or cQurses of action for which the effective- 
ness data will serve as an input must be described explicitly. The list cannot 
be a cosmetic one. It must reflect the agtual decisions to be madej no matter 
hov/ banal > uncomfortable, or painful. For example , the military has always 
had a problem with Officer Fitness Reports Ci*e* performance appraisals). Tlie 
distribution of ratings is very negatively skewed and almost everyone looks 
absolutely great. However^ the fitness report serves several purposes, not all 
of which are compatible. For promotional purposes it would be nice to distinguish 
clearly among individual subordinates* Hov/ever, a commanding officer often uses 
high ratings to create high morale in his groi^. Also, the higher the overall 
ratings of his subordinates^ the better he looks to his o\m superiors • 
Obviously, the same data cannot serve such conflicting demands very well. It 
ought not be asked to do so* No amoimt of psychometric slight of hand will 
overcome the conflict. Vao overall morale is the same for determining 
organizational effectiveness* At every stage in the process two questions must 
b© asked, V^ill the data base toward which wo are moving answer the questions v;e 
want it to answer? Are v^e inadvertently moving toward asking the same data to 
serve conflicting aims? 

The next ingredient is the specification of the task objectives of the 
organization or subunits under consideration. Again, the list v/ould be quite 
long, highly specific, and a lot of work to generate. Obviously^ this is a re- 
jection of the notion that organizations are too complex to knov/ what they are 
trying to do, It is assumed here that it is ''good'' to know. 
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Once the list of task objectives is specified, several value judgments 
must be made about it. The inajor ones ar'-j; 

A. The organisation must decide which are considered means and which 
are considered ends. Is a particular objective a dependent variable 
in its own rights or is it really an independent variable that the 
organization hopes will ''cause-' certain changes in some more terniinal 
outcome. Expressed job satisfaction is the classic example about 
which such a judgment must be made. 

B. The conditions under v/hich the organization should be able to 
accomplish a particular objective must also be spelled out to the 
fullest extent possible. Clianges in regulatory statutes ^ economic 
conditions, tlie available labor supplyj etc., are examples of things 
to be considered. 

C. The relative importance of each objective sliould also be judged. 

If the above judgnents are made in a thorough and systematic manner ^ the 
real conflict in the organization will be identified. It is too much to ej^ect 
for there to be complete unanimity in these matters; and if the organization 
internalizes this model of effectiveness^ it will not have such an expectation. 
It is also obvious that from this point of view^ strategies of conflict reso- 
lution will play an important part in the assessment of organizational effective^ 
1 

ness. 

Tlie overall definition of organizational effectiveness then, is the degree 
to which the task objectives judged to be -'ends'' are being accon^lished. It is 
at this point_, and not before, that the question of how to measure the degree 
of goal attainment becomes operative* Too frequently v;e have jumped iiiunediately 
to the question of what questionnaire or criterion measure to use before con- 
sidering these prior, md perhaps more important, questions. In the training and 
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educational field, from whence this model camr;, tlds is analogous to seising 
upon a training technique before deciding what it is we \mnt to teach* I would 
submit that the measurement problems pale in comparison to the prior questions 
and that when they are answered, the measurement problenis will be substantially 
resolved. 

One vexing problem that arises at this point has to do with conipgiri ng 
organizations in terms of tlieir effectiveness, since the model tends toward an 
idiosyncratic definition of effectiveness. Hov/ever^ from a decision making 
point of view J such comparisons v^ould only be made if the organizations indeed 
shared tasks in common* If no set of common tasks can be identified^ then 
there is something strangt* about wanting to make the comparisons, 

RESEARCH TO 3C mm 
Our review of the existing empirical literature on org* effectiveness 
yielded 2 major conclusions, among others. 

1) I lost of the criteria used in sucli studies are measures of convenience^' 
and thus are difficult to interpret in any generalizeable way. 

2) Tlie multivariate procodure of criterion exploration that measures a 
large number of organisations on a large number of possible criteria and then 
examines the correlation matrix for a parsimonious set of common factors is 
probably not a fruitful way to proceed. Obtaining a large number of obser- 
vations is too costly and defining the same variable t}i jame way across all 
organizations is difficult. 

As a consequence J I propose that we drop back several paces and concentrate 
on some very fundarAental empirical questions, 

A, It would be advantageous to spend a certain amount of time in 

straightforv/ard descriptive studies of the kinds of goal setting 

activity that goes on in orgmizations and the incentive systems 

that maintain it. Baseline data are in^ortant and we have very little of them, 

3, VJe must also devote a certain amount of effort to developing 
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t..U„i,ues for task Co.l »alysis. This is ..algous to U.velopin, 
job desciptlo. teclmiques for individual ,crfo™nce. We ,.ill have 
„ find out the «t cost effective ,„et„od for obtaining comprehensive 
descriptions of tasK objectives for the relevant parties. 
C Tb.e value questions cf which ^oals are '^ends^^ rather than '■.eans." 
wKich are the »ost i^port^t, and the condltiens under v.hich goal 
aeco.plis,»ent is expected are hu„,an jud..3nts that .ust be .ade. As 
,„oh, the processes by which such value judgments are made are In^crtant 
areas for rssBarch. 

:: ,e„eral, what I hope I a. preachin. for is research that involves 

^ -F .tnr -mfllyM^. rlfl*" "^^^ description not pre= 
multidimensional scaling not factor ,mRlysi , r 

diction, and a concentration on p.ocassos not outcomas. 
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